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Abstract 

Improving inclusive middle school science teachers’ vocabulary instruction is a critical step toward 
helping those professionals support the learning needs of all students. In this Institute of Education 
Sciences (IES)—funded project, inclusive science teachers received professional development using 
elements of a multimedia-based approach called the Content Acquisition Podcast Professional 
Development (CAP-PD) intervention process. In this article, the authors discuss the three iterative 
pilot studies conducted as a part of this project and how each contributed to its development. 
Drawing on a theoretical framework that considers the characteristics of effective professional 
development, CAP-PD has three elements: (a) use of instructional videos that highlight the steps 
of practices and embed modeling videos to demonstrate practice, (b) preproduced instructional 
materials that support the implementation of evidence-based practices, and (c) feedback for 
teachers using data outputs from a classroom observation tool developed as a part of this project. 
Across studies, teachers who engaged in the CAP-PD process made important gains in terms of 
how much time they spent delivering evidence-based vocabulary instruction and the number of 
different practices implemented with fidelity. Future research should address questions of the 
lasting impact of this process on student learning and how to adapt the CAP-PD to help teachers 
do more than improve their vocabulary instruction. 
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The framers of the U.S. Constitution recog- 
nized the importance of scientific education 
when they granted Congress the power to 
“promote the progress of science and the use- 


States consistently lags behind other devel- 
oped nations (Fleischman, Hopstock, Pelczar, 
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ful arts.” Yet, despite historical associations 
between science learning and civic, economic, 
and industrial progress (Quinn, Schweingru- 
ber, & Keller, 2012; Turner, 2008; Villanueva, 
2010), science achievement in the United 
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& Shelley, 2010). Our nation has taken notice. 
In the last quarter century, improving the 
quality of science education has regained 
prominence as a priority in the United States 
(Quinn et al., 2012). Although the National 
Assessment of Educational Progress (NAEP) 
science assessment data shows gradual 
increases in scientific achievement nation- 
wide, only 41% of fourth-grade students and 
37% of eighth-grade students demonstrated 
proficiency on the 2015 assessment (National 
Center for Education Statistics [NCES], 
2015), suggesting that proficient achievement 
on a broad, comprehensive scale remains elu- 
sive. 

The aforementioned statistics demon- 
strate that many American students are 
struggling with science achievement, but 
students with disabilities (SWD) are per- 
forming even worse. According to the 
results of the 2015 NAEP, SWD score sig- 
nificantly lower than students without dis- 
abilities, with only 18% of fourth graders 
with disabilities and 11% of eighth graders 
with disabilities meeting proficiency stan- 
dards. This achievement gap is persistent 
and, based on trajectories from the last 
quarter century, unlikely to close without 
focused and empirically validated instruc- 
tional interventions. That said, research 
suggests that SWD are capable of learning 
complex science content and achieving at 
levels commensurate with their peers with- 
out Individualized Education Programs 
(IEPs; Therrien, Taylor, Hosp, Kaldenberg, 
& Korsch, 2011). 

This article addresses the problem of low 
achievement for SWD in science by explor- 
ing the development of an instructional 
intervention—Content Acquisition Podcast 
Professional Development (CAP-PD)—a 
multimedia professional development (PD) 
process designed to teach inclusive science 
teachers how to implement evidence-based 
practices for SWD. Our purpose herein is 
twofold: to disseminate the iterative process 
used in development of the CAP-PD across 
three pilot studies, and to outline the poten- 
tial and promise of this innovative process 
for changing teachers’ practice. 


Effective Science Instruction 
for SWD 


To improve academic outcomes in science for 
SWD, it is important to identify what the field 
of science education considers effective 
instruction for a// students and the instruc- 
tional practices that promote access to that 
same level of educational opportunity for 
SWD. At the heart of contemporary under- 
standings of scientific learning are the Next 
Generation Science Standards (NGSS). With 
a three-pronged focus on core ideas, scientific 
practices, and cross-cutting concepts (Quinn 
et al., 2012), NGSS promote the practice of 
inquiry in the classroom. Sometimes mischar- 
acterized as merely hands-on learning, 
inquiry-based instruction actually provides 
educational opportunities for students to 
engage with content knowledge by develop- 
ing questions, making observations, and con- 
ducting investigations to discover scientific 
theory (Maroney, Finson, Beaver, & Jensen, 
2003). Inquiry is less of an instructional activ- 
ity and more of a cognitive process that pro- 
motes a deep understanding of the overarching 
concepts, models, and theories that order our 
world (Palincsar, Magnusson, Cutter, & Vin- 
cent, 2002). 


Inquiry and SWD 


Although few would argue with the merits and 
logic of inquiry-based instruction, there is no 
compelling empirical support for its use as a 
stand-alone practice for teaching SWD (Rizzo 
& Taylor, 2016). A small body of research, 
however, underscores that, when teachers pro- 
vide appropriate curricular supports, an 
inquiry-based approach to science instruction 
benefits SWD (Mastropieri & Scruggs, 1992; 
Mastropieri, Scruggs, & Magnusen, 1999; 
Mastropieri et al., 2006; Scruggs, Mastropieri, 
& Boon, 1998; Therrien et al., 2011). Effective 
supports include using adapted texts, study 
guides, and graphic organizers; focusing on 
increasing the clarity and redundancy of criti- 
cal content in curriculum and _ instruction; 
employing varied grouping structures that 
allow students to interact with peers; and 
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implementing empirically validated strategies 
that target vocabulary knowledge teachers 
provide necessary structure. Across these stud- 
ies, researchers found that providing structure 
to inquiry experiences was associated with 
positive academic, behavioral, and motiva- 
tional outcomes for SWD (Rizzo & Taylor, 
2016). More research, however, is needed, 
particularly around the role of students’ vocab- 
ulary proficiency in successful engagement 
within inquiry-based tasks and related assess- 
ments (McGrath & Hughes, 2017). 


The Importance of Vocabulary for 
Science Learning 


In the content areas of the curriculum, such as 
science and mathematics, researchers have 
found that vocabulary knowledge is associ- 
ated with increased achievement and that 
vocabulary deficits often serve as a barrier to 
learning (Baumann, Kame’ enui, & Ash, 2003; 
Saenz & Fuchs, 2002). Science curricula, in 
particular, are replete with technical vocabu- 
lary terms and concepts that impact students’ 
understanding of texts and instruction (Bry- 
ant, Ugel, Thompson, & Hamff, 1999; Saenz 
& Fuchs, 2002) and potentially prohibit equi- 
table access to higher level tasks and pro- 
cesses (Elleman, Lindo, Morphy, & Compton, 
2009; Yore, Hand, & Florence, 2004). Yet, 
this problem presents a fruitful opportunity 
for science teachers to structure learning 
experiences through the use of explicit vocab- 
ulary instruction (Archer & Hughes, 2011). 
The subfield of science and disability has a 
history of instructional practices for teaching 
vocabulary that—when used with fidelity— 
result in increased achievement (Rizzo & Tay- 
lor, 2016; Scruggs, Mastropieri, & Okolo, 
2008; Therrien et al., 2011). These vocabulary 
practices include direct instruction using stu- 
dent-friendly definitions (Ford-Connors & 
Paratore, 2015), purposeful opportunities for 
students to make connections between new 
and known vocabulary (McKeown & Beck, 
2004; Nagy, 2005; Stahl, 2005), explicit 
instruction in the use of morphology (Graves, 
2004; Harris, Schumaker, & Deshler, 2011; 
Jitendra, Edwards, Sacks, & Jacobson, 2004), 


and the use of examples and non-examples 
(McKeown & Beck, 2004; Stahl, 2005). These 
types of interventions or practices are effec- 
tive because they provide explicit instruction 
that creates varied opportunities for students 
to connect known words to new words, thus 
building their mental maps of the terms and 
concepts that comprise the scientific disci- 
pline (Vaughn & Linan-Thompson, 2003). 
Using these instructional practices in tandem 
with an inquiry-based approach to learning 
allows science teachers—who are expected to 
provide inquiry-based instruction that aligns 
with state standards and/or the NGSS (NRC, 
2012)—1o structure learning experiences in 
ways that have the potential to mitigate the 
persistent achievement gap between SWD 
and their same-grade peers (NCES, 2015). 


Present State of Science 
Instruction for SWD 


Descriptive research on instruction in the field 
of science instruction for SWD is limited, but 
demonstrates that many science teachers’ les- 
sons focus heavily on whole group, teacher- 
dominated lecture, often at the expense of 
inquiry-based or lab-based activities (Ken- 
nedy, Rodgers, Romig, Lloyd, & Brownell, 
2017; Harbort et al, 2007; King-Sears, 
Brawand, & Jenkins, 2014; Moin, Magiera, & 
Zigmond, 2009; Mutch-Jones, Puttick, & 
Minner, 2012). Observational studies of inclu- 
sive classrooms have confirmed that the gen- 
eral educator is the primary presenter of 
information to all students, even in co-taught 
classes, for whole-group lessons and small- 
group interactions (Harbort et al., 2007; King- 
Sears et al., 2014; Moin et al., 2009). These 
observational data support the need for gen- 
eral educators to understand how to imple- 
ment effective practices for SWD. 

One potential reason for teachers’ reliance 
on teacher-dominated instruction is that the cur- 
ricular expectations placed on general educa- 
tion science teachers at the secondary level are 
“a mile wide and an inch deep” (Kesidou & 
Roseman, 2002). Possibly because of the vast 
amount of content to be covered in preparation 
for state and other assessments, teachers revert 


Kennedy et al. 


143 


to teaching methods that are perceived to be 
efficient (e.g., whole-group lecture) to get 
through the curriculum (Schmidt, Wang, & 
McKnight, 2005). This means the reality of sci- 
ence instruction for SWD is quite different from 
the ideal union of inquiry and structured sup- 
ports researchers have identified as beneficial 
for SWD (Mastropieri & Scruggs, 1992; Mas- 
tropieri et al., 1999; Mastropieri et al., 1998; 
Scruggs et al., 1998; Therrien et al., 2011). 


Need for PD for Inclusive 
Science Teachers 


One reason for the disconnect between the type 
of instruction researchers have found effective 
for SWD and the instruction those students 
actually receive may be related to a gap in 
teacher knowledge. In the United States, the 
majority of SWD receive the bulk of their edu- 
cation in the general education setting (U.S. 
Department of Education, 2016), and the gen- 
eral education setting is often the only opportu- 
nity SWD have to access the science curriculum 
(Vannest et al., 2009). Consequently—though 
there are often opportunities for students to 
receive supplemental support outside of the 
classroom—the individual mainly responsible 
for science instruction is the general educator 
(Vannest et al., 2009). This is problematic 
because general education teachers often report 
feeling unprepared to teach SWD and unsup- 
ported in the effective use of inclusive instruc- 
tion and evidence-based practices for SWD 
(Robinson, 2002; Wei, Darling-Hammond, & 
Adamson, 2010). In a recent position state- 
ment, the National Science Teachers Associa- 
tion (2017) recognized this problem and 
presented PD as one possible solution for help- 
ing science teachers “. . . learn about the unique 
needs of students with exceptionalities and 
how to meet those needs in the science class- 
room” (p. 2). 

If teachers do not receive a strong ground- 
ing in teaching practices for SWD during their 
in-service program, it is typically left to school 
or district provided PD offerings to supple- 
ment their knowledge and skills. That said, PD 
offerings are usually expensive and time- 
intensive, and have questionable effectiveness 


(Yoon, Duncan, Lee, Scarloss, & Shapley, 
2007). Researchers have offered multimedia- 
based PD as an alternative to traditional PD 
sessions (see Kennedy, Hirsch, Rodgers, 
Bruce, & Lloyd, 2017), but ongoing rigorous 
research is needed to capture its effectiveness 
and efficiency. 

To address these concerns, our research 
team conducted a series of iterative studies 
with the CAP-PD process at the core to attend 
to the needs of students—through promoting 
the evidence-based practices highlighted in 
this article—and of teachers—by drawing on 
evidence-based principles of effective PD. In 
the remainder of this article, we discuss the 
conceptual framework driving this work and 
the research process through which we devel- 
oped and adapted the CAP-PD. 


Conceptual Framework 


The design of the CAP-PD process has the 
cognitive apprenticeship framework (Col- 
lins, Brown, & Newman, 1989) as its foun- 
dation. Cognitive apprenticeship is a 
multifaceted framework for instruction that 
has implications for the content, methods, 
sequencing, and sociology of learning. At 
the core of cognitive apprenticeship is a 
model—coach-scaffold cycle to support the 
learning of new skills. These elements are 
heavily present in CAP-PD (described 
below) and have considerable support in the 
PD research literature. For example, Dar- 
ling-Hammond, Hyler, and Gardner (2017) 
conducted a synthesis of PD studies that had 
positive effects on student outcomes and 
found that modeling was a common practice 
across many of these studies. Also, Kraft, 
Blazar, and Hogan (2017) conducted a meta- 
analysis of 44 studies examining the effects 
of coaching and found that, on average, 
coaching had both a moderately large posi- 
tive effect on teachers’ instruction and a 
smaller positive effect on student outcomes. 
Similarly, other aspects of cognitive appren- 
ticeship are supported by research. Although 
cognitive apprenticeship lacks research sup- 
porting its use as a whole in teacher training 
contexts, the CAP-PD research base has 


144 


Teacher Education and Special Education 41 (2) 


begun to contribute experimental evidence 
in support of cognitive apprenticeship as a 
framework for designing PD opportunities 
for teachers. 


CAP-PD Process 


In response to the vocabulary needs of stu- 
dents with and without disabilities in middle 
school science and in line with our conceptual 
framework, we developed the three interre- 
lated components of CAP-PD intervention: 


1. use of CAPs for Teachers with Embed- 
ded Modeling Videos (CAP-TV); 

2. use of instructional slides teachers can 
adopt and adapt for immediate use 
(Content Acquisition Podcasts— 
Teacher Slides [CAP-TS]); and 

3. receipt of feedback and coaching on 
implementation of specific practices. 


Each component is described in detail in 
this section. The goal is to create a PD inter- 
vention process that supports teachers’ use of 
evidence-based practices for teaching critical 
vocabulary terms and concepts to students in 
content area classrooms in a way that results 
in meaningful learning outcomes for teachers 
and students. In addition, the PD process 
should be multimedia, such that it is sustain- 
able, scalable, and possible to replicate. The 
studies in this article specifically address mid- 
dle school science classrooms. 


CAP-TV 


CAP-TVs are short (10-15 minutes), multi- 
media vignettes that (a) provide direct instruc- 
tion about specific vocabulary practices 
(CAPs for Teachers [CAP-T]) and (b) model 
implementation with fidelity (CAP-TV). 
These videos are designed in accordance with 
Mayer’s (2009) Cognitive Theory of Multi- 
media Learning and consist of clear images, 
limited text, tight narration, and a short mod- 
eling video. A sample CAP-TV is available at 
https://vimeo.com/143387419. Kennedy and 
his colleagues have completed four direct 
empirical tests of the impact of CAP-TV on 


teacher learning across content areas (Alves 
et al., 2017, Ely, Kennedy, Pullen, Williams, 
& Hirsch, 2014; Kennedy, Rodgers, et al., 
2017; Kennedy, Hirsch, et al., 2017). In each 
study, teachers who learned from the CAP-TV 
approach implemented more elements of spe- 
cific evidence-based practices with fidelity 
than comparison teachers who learned using 
traditional lectures or other PD approaches. 
CAP-TV addresses the need to focus PD on 
specific instructional practices rather than 
content more generally (Garet, Porter, Desim- 
one, Birman, & Yoon, 2001). The CAP-TV 
library provides the modeling phase of the 
cognitive apprenticeship conceptual model. 


CAP-TS 


To scaffold teachers’ implementation of the 
target instructional practices, the package 
includes PowerPoint slides teachers can 
download and use during instruction. Our 
research team hired middle school science 
teachers to write and validate the content con- 
tained within the slides. Each CAP-TS con- 
tains slides for at least one but often two or 
three related vocabulary terms or concepts at a 
time, and includes the following instructional 
sequence: (a) reviewing key background 
knowledge, (b) providing a student-friendly 
definition, (c) teaching relevant examples or 
non-examples (when appropriate), (d) high- 
lighting and teaching morphological features 
of the term (when appropriate), (e) comparing 
and contrasting the term with semantically 
related terms, and (f) repeating the definition. 
The slides conform to Mayer’s (2009) applied 
theoretical model in terms of how they lever- 
age vivid images, occasional on-screen text, 
and a script for supporting teachers use of 
clear, consistent language. In line with the 
research regarding effective science instruc- 
tion for SWD (Mastropieri & Scruggs, 1992; 
Mastropieri et al., 1999; Mastropieri et al., 
1998; Scruggs et al., 1998; Therrien et al., 
2011), the CAP-TS narratives emphasize crit- 
ical content by providing a structure that is 
clear and redundant where appropriate, effec- 
tively pacing instruction through the use of 
student cues (e.g., “Let’s get ready to look at 
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some examples and non-examples of symbio- 
sis.”), and embedding opportunities to respond 
and receive feedback. 

The instructional practices taught and 
modeled within the CAP-TV vignettes are 
embedded into the CAP-TS providing tacit 
reinforcement and prompting for teachers to 
use the practices. In fact, the model teacher 
uses CAP-TSs in the embedded video. To 
ensure the content of the PD aligns well with 
the content teachers are actually teaching, the 
CAP-TS materials are customizable and 
teachers are encouraged to combine them 
with their existing instructional materials. In 
particular, the CAP-TS slides were created 
using vocabulary lists provided by teachers 
and a review of the state science standards, 
thereby supporting the material teachers are 
required to teach. The CAP-TS illustrate the 
modeling phase of the cognitive apprentice- 
ship conceptual framework, and provide scaf- 
folding as well. Sample CAP-TS can be found 
at www. VocabSupport.com. 


Feedback From Observations and 
Coaching 


The final component of CAP-PD is to observe 
teachers’ instruction using an observation 
instrument called the Classroom Teaching 
(CT) Scan, which is a low-inference instru- 
ment that records instructional moves in real 
time (Kennedy, Rodgers, et al., 2017. The CT 
Scan allows for collection of data concerning 
the duration of discrete instructional practices 
used as well as counts of questions and feed- 
back statements teachers provide to students. 
The CT Scan also records the quality of imple- 
mentation of the practice, or the extent to 
which teachers’ enactment of the practices cor- 
responds to the instruction provided in the 
CAP-TVs. The CT Scan produces visual 
graphic outputs representing the use of class 
time and the practices used, which are pro- 
vided to teachers along with instruction about 
how to interpret the graphs (the CT Scan can 
be found at www.classroomteachingscan.com/ 
ctscan/ and a sample output can be seen at 
http://www.classroomteachingscan.com/ 
ctscan/timeline.htm?menus.txt&2 13). 


To support the visual feedback, teachers 
receive an email highlighting specific aspects 
of their instruction (see http://www.class- 
roomteachingscan.com/ctscan/reportmaker. 
htm?213, for a customizable online template). 
The email can include specific praise for 
things the teacher did well (e.g., “You pro- 
vided your students an anticipatory set to let 
them know what to expect from this class, and 
you did it beautifully, with a cue to get their 
attention and a reference to the relevance and 
importance of the topic at hand.”’). The email 
can also provide specific suggestions for 
improvement (e.g., “I noticed that during the 
last 30 minutes or so of the class, you only 
asked 4 questions. Asking more questions or 
giving students other ways to respond to the 
content, particularly at the close of a lesson, 
helps to cement their learning and makes it 
more likely that they will remember the infor- 
mation.”). Within the template, researchers 
send teachers “One Big Thing,” which is a 
key area for them to work on prior to the next 
lesson or observation. The observations and 
related feedback add to the active learning 
component, tying the PD directly to teachers’ 
instruction and making them part of the learn- 
ing process. Using the CT Scan and resulting 
descriptive data for delivering coaching and 
feedback rounds out how the CAP-PD pro- 
cess operationalizes the cognitive apprentice- 
ship conceptual framework. 


Description of Research 
Process and Key Findings 


The CAP-PD research project was funded by 
the National Center for Special Education 
Research’s (NCSER) Early Career Develop- 
ment and Mentoring research training pro- 
gram. The studies conducted over the past 
several years within this Goal 2, Development 
and Innovation project, have been informed by 
Hill, Beisiegel, and Jacob’s (2013) recommen- 
dations for conducting more rigorous research 
on teacher PD. In particular, the CAP-PD stud- 
ies incorporate “a series of small-scale but rig- 
orous trials to determine the effects of various 
program delivery features on mostly proximal 
outcomes” (p. 485) in the early stages of PD 
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development, with the intent of creating a PD 
intervention ready for further efficacy trials in 
a subsequent project. 

Thus far, the first two stages of Hill and 
colleagues’ (2013) recommended progression 
have been used in the CAP-PD research pro- 
gram to help refine the CAP-PD in prepara- 
tion for future studies (1.e., “one-site pilot” 
studies and “randomized controlled trial hold- 
ing content the same but varying features of 
program delivery”; p. 479). The questions 
driving this research are as follows: 


Research Question 1: What are teachers’ 
initial perceptions of the CAP-PD process 
and its perceived usefulness? 

Research Question 2: For researchers, in 
what ways is the CAP-PD process feasible 
to implement? 

Research Question 3: To what extent does 
engagement in the CAP-PD process result 
in inclusive middle school science teachers 
making measurable gains in the quality and 
quantity of their vocabulary instruction? 
Research Question 4: Do SWD make 
learning gains when taught by teachers 
using high quality vocabulary instruction? 


Teacher and Student Population 
Studied 


A total of 34 teachers drawn from 18 rural 
schools participated in three studies spanning 
the 2014-2017 school years (three teachers in 
Pilot Study 1 [2014-2015], three in Pilot Study 
2 [2015-2016], and 28 in Pilot Study 3 [2016- 
2017]). The teachers in our studies were mid- 
dle school science teachers who worked in 
inclusive classrooms, defined as classes com- 
prising students with and without disabilities. 
All teachers worked in rural districts that 
served students from predominantly lower 
socioeconomic backgrounds. Of the 36 teach- 
ers, all were certified to teach science in their 
state, and the average number of years teach- 
ing was 11.2 (SD = 3.6). Six of the teachers 
were male, one was Hispanic, and one was 
Asian. The focus to date has been on teacher 
performance and outcomes; however, 1,779 
total students participated in the third study, of 


which 251 (14.1%) were identified as having 
an IEP. Observations of teacher practice were 
conducted live and via video. 


Pilot Study | 


In the first pilot study, three middle school sci- 
ence teachers from different schools received 
an early version of three CAP-Ts (contained 
narration and images only, no embedded mod- 
eling video) to learn three key practices for 
teaching vocabulary: (a) use of student- 
friendly definitions, (b) examples and non- 
examples, and (c) the highlighting and 
defining of morphological parts of words. 
Each teacher watched each video once. The 
teachers had been teaching for 3, 5, and 7 
years. The teachers also received early ver- 
sions of CAP-TS to support implementation 
of practices. The early-version CAP-Ts and 
CAP-TS, however, were not perfectly aligned 
(i.e., the practices taught within the CAP-Ts 
were neither broken into specific steps nor 
specifically represented in the slides). The 
assumption was that exposure to the CAP-Ts 
and slides would be enough to spur changes in 
implementation of the three vocabulary prac- 
tices. At the time of this study, the CT Scan 
did not exist in its current form. A paper-based 
predecessor was used to record data but teach- 
ers did not receive feedback on their perfor- 
mance using the CT Scan as part of the 
intervention. The main purpose of this study, 
in accordance with Stage | of Hill et al.’s 
(2013) recommended progression, was to 
determine whether the PD process was feasi- 
ble to implement and to collect social validity 
data from participating teachers. 


Method. The teachers videotaped their teach- 
ing 5 days prior to accessing the CAP-Ts (base- 
line), and then 5 days after (post intervention). 
A one group, pre-post design was utilized. 
Teachers uploaded videos to a secure collabor- 
ative site provided by the researchers’ univer- 
sity. Two members of the research team coded 
approximately 25% of the videos. The observ- 
ers were the principle investigator and two doc- 
toral students, each with an average of 6 years 
as classroom teachers and are the authors of the 
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CT Scan. Inter-scorer reliability was 70% for 
number of vocabulary practices being used by 
teachers. Based on these results, members of 
the research team noted patterns across lessons 
and compared impressions of the instruction. 
Data were not analyzed in relation to PD effec- 
tiveness, but on teachers’ use of the CAP-TS 
and their perceptions of the process. 


Results. Prior to the CAP-PD, teachers pro- 
vided textbook definitions or had students 
copy words and definitions from the glossary 
in their text during each lesson (teachers 
recorded lessons on days when they taught 
vocabulary). After viewing the PD videos, 
teachers used more vocabulary practices. 
After the intervention, teachers provided a 
student-friendly definition in each lesson, and 
provided examples and non-examples for 
each term, as outlined in the CAP-TS. 
Researchers measured use of these practices 
using the predecessor for the CT Scan. We did 
note that teachers did not seem to take owner- 
ship of the CAP-TS, instead using them as 
packaged curriculum. Teachers displayed the 
slides to students and read what was on them, 
but they did not alter the slides to align them 
with the rest of their instruction. There was 
also some indication that teachers did not 
even review the CAP-TS before class—they 
would often pause when a slide came up 
before making a statement such as follows: 
“We’re not going to talk about that word 
today—let’s move to the next one.” 

After this pilot study was completed, we 
communicated with participating teachers by 
email to determine their impressions of the 
CAP-PD. All three teachers in their written 
comments to researchers revealed a desire for 
a more intensive PD option than simply 
watching three short videos and accessing 
slides, and for timely feedback on their teach- 
ing. A representative quote was, “I appreciate 
having access to the videos and slides, but I 
didn’t really know what I was supposed to do 
with them. I did the best I could.” A second 
teacher wrote, “I filmed myself like you 
asked, but I didn’t know if I was doing what 
you wanted. Next time it would be good to get 
some feedback.” 


Iterative development of PD materials. This 
study served as a feasibility test, in accor- 
dance with the first stage of the recommended 
sequence for PD research proposed by Hill 
and colleagues (2013). Recommendations of 
the teachers for more robust training spurred 
the development of the CAP-TV library, 
which was upgraded from the original CAP- 
Ts to include specific steps of implementation 
for each practice and the inclusion of a model- 
ing video. Experts in the field of vocabulary 
instruction reviewed each draft CAP-TV and 
provided input on adherence to best practice. 
In addition, as a result of our observations that 
teachers did not take ownership of the CAP- 
TS, we altered them to be more aligned with 
the CAP-TV. 

In addition, in response to the teachers’ 
request for feedback, a computer-based ver- 
sion of the CT Scan was developed that gener- 
ated immediate data to use as part of a 
coaching and feedback cycle. The revised CT 
Scan also allowed for more specific informa- 
tion to be collected on the implementation of 
the vocabulary practices. Previously, we had 
developed lists of steps we expected teachers 
to follow when implementing the practices. 
The paper version afforded an assessment of 
implementation fidelity using a binary system 
(i.e., yes or no), but the specific implementa- 
tion markers for each practice were not listed 
on the CT Scan data tracking form—observ- 
ers would have to use the codebook or have 
the markers memorized (which proved very 
difficult when using a real time, low-inference 
tool such as the CT Scan). 

The computer-based CT Scan improved the 
evaluation by providing the observer with a 
list of implementation markers for each prac- 
tice. The implementation markers are drawn 
from the professional literature for each prac- 
tice, when available. For example, the imple- 
mentation markers for having a discussion are 
drawn from Ford-Connors and Paratore’s 
(2015) synthesis of the literature. The markers 
are as follows: call on students all over the 
room, encourage students to talk and use evi- 
dence, provide an appropriate and authentic 
context, ask open-ended questions, and incor- 
porate student responses into discussions. As 
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an observer watches a teacher use this practice, 
they use the CT Scan to click on each imple- 
mentation marker as a guide, and those left 
unclicked become the targeted areas for 
improvement in the coaching phase. This 
allowed us to provide more detailed feedback 
following the observations and connect the 
feedback directly to the CAP-TV and CAP-TS 
components. These implementation markers 
also greatly improved the observers’ inter- 
scorer reliability, and provided content validity 
as well (see below). 


Pilot Study 2 


Due to the extensive changes made to CAP-PD 
intervention after conducting Pilot Study 1, a 
Second Stage | feasibility study was conducted 
(Hill et al., 2013). Pilot Study 2, which now 
included the CAP-TV, integrated with the 
CAP-TS, and coaching and feedback. A single- 
case, multiple-baseline design study was uti- 
lized to experimentally measure the impact of 
the CAP-PD intervention on inclusive science 
teachers’ implementation of evidence-based 
vocabulary practices. Three teachers with 2 to 
6 years of teaching participated in this study. 
These teachers had a total of 26 students with 
IEPs spread across their classes. Observations 
took place for approximately 6 weeks, and 
teachers were observed between 18 and 24 
times between the baseline, post intervention, 
and maintenance observations. 


Method. Following baseline observations, 
teachers received access to five CAP-TV (stu- 
dent-friendly definitions, examples and non- 
examples, morphological parts, semantic 
relationships among terms, and having dis- 
cussions), which presented specific steps for 
each practice that were derived from the 
empirical literature on vocabulary instruction 
and explicit instruction. Each teacher watched 
each video at least once, and further viewings 
were tracked by researchers using www. 
edpuzzle.com. Next, teachers received access 
to CAP-TS for each vocabulary term in their 
curriculum that were closely aligned with the 
CAP-TV. Finally, after each observation in the 
intervention phase, teachers received a daily 


email containing data output from the CT 
Scan and a personalized email providing feed- 
back and coaching notes as described above. 
When improvement was needed, the email 
would refer the teacher back to a specific 
point in a CAP-TV to provide a model of or 
information about proper implementation. 

Observations were conducted live, and a 
second observer was present for 25% of the 
observations (85% agreement on amount of 
time spent teaching vocabulary and specific 
vocabulary practices). Following the observa- 
tions, the two observers compared results and 
came to consensus on what had occurred. 
Data on the target outcomes (i.e., amount of 
time spent in explicit vocabulary instruction, 
number of vocabulary practices, and percent- 
age of implementation markers used correctly 
within each practice taught in the CAP-TV) 
were graphed and visually analyzed for sig- 
nificance. 


Results. At baseline, teachers spent on aver- 
age 10% of class time (about 5 minutes per 
day) using evidence-based vocabulary prac- 
tices. The most vocabulary practices used 
with fidelity by any teacher were two for any 
given lesson. Following intervention, on aver- 
age, teachers spent 46% of class time on 
vocabulary instruction and used 4.6 practices 
with fidelity per lesson. In the course of the 
entire study, only two lessons from Teacher C 
contained instruction that could be considered 
inquiry-based. At baseline, teachers were 
coded as “observing and assessing” students, 
on average, 42% of the time, which indicates 
the amount of time students were working on 
independent or small-group assignments 
while teachers monitored them. These assign- 
ments were not inquiry-based and instead 
were lower level activities such as students 
working in groups to create study guides for 
vocabulary terms. This percentage was 
reduced to less than 20% post intervention, 
with the lower level activities being replaced 
with explicit instruction provided using the 
CAP-TS and other instruction promoted by 
the CAP-TV. The CAP-PD intervention pro- 
cess was thus successful not only in improv- 
ing teachers’ vocabulary instruction but also 
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in reducing the number of lower level activi- 
ties in which students engaged. Full methods and 
results for this study are available in Kennedy, 
Rodgers, et al., 2017. 


Iterative development of PD materials. During 
observations, researchers noted that teachers 
took ownership of the CAP-TS by customiz- 
ing them to enhance their instruction. All 
three teachers used the slides as a foundation 
and made a number of changes to seamlessly 
incorporate materials into their practice. Some 
instructional changes were substantive, 
including the addition of videos, diagrams, 
and demonstrations. Other changes were less 
so and focused on visual enhancements, such 
as changes in the colors, fonts, or size of 
images to match existing materials. Both sub- 
stantive and design-related changes allowed 
teachers to use the materials with a greater 
level of comfort than was observed in Pilot 
Study 1. 

Although the CAP-PD improved teacher 
practice, the researchers’ workload was heavy. 
Teachers were observed daily and provided 
feedback after each observation. This high 
frequency of observations is not sustainable 
for long periods of time and is not scalable to 
large numbers of teachers. Therefore, the next 
study focused on teasing apart the additive 
effects of each CAP-PD component and on 
determining whether teachers’ practices could 
be improved while maintaining reasonable 
demands on the PD providers. 


Pilot Study 3 


In our third study, we moved to Stage 2 of Hill 
et al.’s (2013) PD research stages by testing 
the impact of specific PD features on teachers’ 
practice. Twenty-eight inclusive middle 
school teachers from 11 rural schools agreed 
to be randomly assigned to one of two experi- 
mental conditions. Although underpowered, a 
randomized control trial design was utilized. 
All teachers were observed 3 times to estab- 
lish a baseline measure of their vocabulary 
instruction, and then 3 more times following 
exposure to PD materials at an interval of 
approximately once per month. Teachers in 


the treatment condition received the full CAP- 
PD intervention process, including access to 
the five CAP-TV, www.vocabsupport.com, a 
website containing approximately 100 CAP- 
TS, and coaching emails using data outputs 
from the CT Scan after each of the three post 
intervention observations. Teachers in the 
comparison condition received access to the 
CAP-TS only, without the CAP-TV or feed- 
back. Researchers therefore tested the impact 
of the CAP-TV and coaching emails using the 
CT Scan while holding access to the CAP-TS 
constant. Each teacher in the CAP-PD group 
watched each CAP-TV twice, per data col- 
lected by www.edpuzzle.com. 


Method. Members of the research team who 
conducted observations were kept blind as to 
which group the teachers belonged. Teachers 
were given the CAP-PD materials according 
to their assigned condition after their third 
baseline observation. Most observations were 
conducted live, but due to scheduling and 
travel constraints, several had to be recorded 
and coded from video. For 20% of the in-per- 
son observations, a second observer was 
either present in the classroom or watched the 
video. Inter-observer reliability was calcu- 
lated by comparing percentages on the target 
outcomes. Inter-observer agreement for per- 
cent of time spent teaching vocabulary was 
95%, use of specific vocabulary practices was 
92%, and agreement on implementation mark- 
ers within each vocabulary practice was 89%. 
Disagreements were resolved via discussion. 
Goal 2 studies support the development of 
interventions intended to produce positive 
outcomes for students in authentic settings, 
such as science classrooms. Consequently, 
student-level data were also collected in Pilot 
Study 3—1,779 students participated, includ- 
ing 251 with IEPs. Over 70% of all students 
were from low socioeconomic backgrounds 
as measured by their receipt of free or reduced 
lunch at school. Students completed a 
standardized pre- and posttest of science 
knowledge (e.g., Misconceptions-Oriented 
Standards-Based Assessment Resources for 
Teachers [MOSART], see https://www.cfa. 
harvard.edu/smgphp/mosart/testinventory_2. 
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html), and three curriculum-based vocabulary 
probes (20 multiple-choice terms each, ran- 
domly drawn from the teachers’ curriculum). 
The curriculum-based measurement (CBM) 
probes were spaced to coincide with monthly 
observations, and confirmed in structure and 
procedures for administration to best practice 
using CBMs described by Espin, Shin, and 
Busch (2005) and others. 


Quality vocabulary index (QVI). The CT 
Scan does not automatically generate a qual- 
ity score following an observation. In Pilot 
Study 2, simple descriptive data were used 
to examine differences as the teachers pro- 
gressed through the CAP-PD process. To 
analyze, however, descriptive data that the 
CT Scan does collect in a randomized control 
trial design, it was necessary for researchers 
to have an interpretable score. Therefore, the 
QVI was created. 

The QVI is a new, but transparent statistic 
that allows researchers to use descriptive data 
from teachers’ observations and make inter- 
group comparisons, and evaluate growth over 
time. The QVI is presented mathematically 
below: 


Amy BP 


ovi=2{(++1)2| 


where x is the percentage of implementation 
markers (fidelity) used for a given practice, y 
is the duration (seconds) that the teacher dem- 
onstrated the given practice, and z is the dura- 
tion (seconds) of the entire lesson. Each 
(x+ly/z is the percentage of implementa- 
tion markers used for an individual practice 
weighted by the proportion of class time spent 
in that practice. This term is calculated for 
each distinct iteration of a practice. Ifa teacher 
uses three separate practices (student-friendly 
definition, morphological analysis, and exam- 
ples of terms) in a lesson, she would have 
three weighted fidelity terms. Likewise, if the 
teacher used one practice (examples of terms) 
three separate times in a lesson, she would 
have three weighted fidelity terms. All 
weighted fidelity terms for each practice in an 
observation are summed to create the total 
QVI score for an observation. 


One assumption we made about instruction 
is that the QVI should give teachers credit for 
using a practice even if they demonstrated 0% 
fidelity. Our rationale was that using an evi- 
dence-based practice poorly should be better 
than not using evidence-based practices at all. 
Because of this, we added a “1” to every x . If 
we had not done this step, the score would not 
have included any practices where the teach- 
ers demonstrated 0% fidelity because 0 multi- 
plied by anything else would equal 0. Table 1 
includes two examples of QVI scores based 
off actual teacher data. The first represents a 
high example, and the second is a low exam- 
ple. The second example in Table 1 demon- 
strates that even if a teacher uses two 
evidence-based practices with high quality, 
the resulting QVI will be low if not used for 
much time (less than 3/90 minutes in this 
example). 


Teacher results. Researchers conducted 76 
baseline and 80 post intervention observations 
for a total of 8,767 minutes (average = 55.8 
minutes/lesson) between August and January 
of an academic year. At baseline, teachers in 
the treatment condition (full CAP-PD) spent 
an average of 8.2 minutes (SD = 13.4) explic- 
itly teaching vocabulary per lesson, and had a 
mean QVI of .2460, SD = 0.321. Colleagues 
in the CAP-TS-only condition explicitly 
taught vocabulary for an average of 9.5 min- 
utes (SD = 10.3) per lesson, and had a QVI of 
.2724, SD = 0.301, FC, 75) = .138, p =.711. 
For the three observations at post interven- 
tion, teachers in the CAP-PD group spent an 
average of 29.5 minutes per lesson explicitly 
teaching vocabulary (SD = 13.5), and saw 
their mean QVI rise to .9035, SD = 0.377. 
Teachers in the CAP-TS group spent an aver- 
age of 15.9 minutes per lesson explicitly 
teaching vocabulary (SD = 11.6), and had 
their mean QVI rise to .5117, SD = 0.465. The 
difference between the groups’ performance 
at postintervention was statistically signifi- 
cant, and a large effect size was detected— 
F(, 78) = 17.2, p< .001, d= .93. 


SWD results. SWD with teachers in the CAP- 
PD condition (N= 132, M= 17.8, SD = 6.9) did 
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Table I. Sample QVI Data. 
Duration Duration of Percentage of fidelity 
Teacher (minutes) Vocabulary practice practice (seconds) implementation QVI 
082 90 Student-friendly definition 40 0.33 1.49 
Formal definition 66 1.00 
Example 558 1.00 
Ask students to state definition 18 0.50 
Example 481 1.00 
Student-friendly definition Il 1.00 
Example 200 1.00 
Ask students to state definition 28 1.00 
Morphological analysis 46 0.75 
Student-friendly definition 98 1.00 
Example 260 1.00 
Student-friendly definition 36 1.00 
Morphological analysis 55 0.25 
Example 122 0.75 
Semantic feature analysis 122 0.66 
Example 229 1.00 
Student-friendly definition 189 1.00 
Example 663 0.50 
Student-friendly definition 73 1.00 
Morphological analysis 24 0.50 
Student-friendly definition 39 0.33 
Analogy 102 1.00 
Example 362 1.00 
Student-friendly definition 120 1.00 
061 90 Ask student to state definition 43 0.50 0.07 
Example 106 1.00 


Note. QVI = quality vocabulary index. 


not score significantly differently than peers 
with teachers in the CAP-TS-only condition 
(N= 119, M= 18.5, SD = 6.7) on the MOSART 
pretest, F(1, 249) = .517, p = .473. SWD, how- 
ever, in the CAP-PD group (M= 23.3, SD=7.4) 
did significantly outperform peers in the CAP- 
TS-only group (M = 20.1, SD = 8.0) on the 
MOSART posttest, F(1, 238) = 9.8, p = .002, 
d=.54. The MOSART has three parts: physical 
science, life science, and astronomy, and has 60 
total points. 

SWD with teachers in the CAP-PD condi- 
tion (CBM 1, M= 10.3, SD = 3.5; CBM 2, M 
= 11.9, SD = 3.4; CBM 3, M= 13.0, SD = 3.5) 
significantly outscored peers with disabilities 
from the CAP-TS condition (CBM 1, M=9.1, 
SD = 3.5; CBM 2, M= 9.3, SD = 3.6; CBM 3, 
M= 10.4, SD = 3.5) on all three CBM probes: 


CBM 1, F(1, 240) = 6.5, p = .011, d = .33; 
CBM 2, F(1, 239) = 31.5, p < .001, d = .73; 
CBM 3, F(1, 228) = 28.2, p < .001, d =.70. 
Each CBM probe had 20 vocabulary terms 
randomly drawn from the teachers’ curricu- 
lum and was administered with procedures 
adapted from Espin et al. (2005). 


Iterative development of PD materials. These 
results demonstrate that having access to five 
CAP-TV and three feedback emails using the 
CT Scan provides teachers with enough 
information regarding their instructional per- 
formance to change their practices, com- 
pared with the CAP-TS only. In addition, the 
SWD from teachers’ who participated in the 
CAP-PD made important and statistically 
significant gains in their performance on a 
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standardized science measure, and three 
CBM probes. In future studies of the CAP- 
PD intervention process, we plan to maintain 
the reduced number of observations rather 
than attempting to conduct them daily. 

In addition, data were gathered from par- 
ticipants using an online survey that informed 
updates to the PD materials. First, teachers 
reported benefiting from the CAP-TVs, CAP- 
TS, and CT Scan feedback emails (Prompt: 
The quality of my teaching benefited from 
participating in this project: strongly agree, 
agree, neutral, disagree, strongly disagree). 
The mean score for teachers in the CAP-PD 
condition was 4.2 (SD = 0.3). 

The survey concluded with an open field 
for suggestions. Five teachers proposed col- 
lapsing the CAP-TS into groupings by topic 
unit (e.g., individual slide shows on velocity, 
speed, motion, and acceleration were com- 
bined into one, as these terms are often taught 
together). Four teachers noted liking the CT 
Scan data and feedback, but were over- 
whelmed at first stemming from how different 
it is from any feedback previously received. 
The research team responded by making a 
tutorial for future teachers on how to interpret 
the CT Scan data. Teachers also requested that 
the CAP-TS include more than vocabulary 
instruction. They asked for sample demon- 
strations and hands-on activities to be included 
within the slides to help them connect the sup- 
ports provided by explicit vocabulary instruc- 
tion to higher level application activities. 
These changes are also present in the current 
versions of our curriculum materials (see 
www.vocabsupport.com). 


Implications for Future 
Research 


The goal of any Goal 2 Institute of Education 
Sciences (IES)—funded project is to iteratively 
develop an intervention with the intent of gen- 
erating promising empirical results and to jus- 
tify further experimental trials at increasingly 
larger scales. In the case of this project, com- 
bining an IES Goal 2 project with an Early 
Career Development and Mentoring project 
provided resources that have been pivotal in 


shaping and reshaping an intervention aimed 
at improving teacher practice. The theory and 
practice underlying this research builds on 
experimental trials conducted by Mastropieri, 
Scruggs, and colleagues (i.e., Mastropieri 
et al., 1999; Mastropieri et al., 1998; Mastrop- 
ieri et al., 2006) and by researchers in the field 
of evidence-based practice for vocabulary 
instruction to build a PD process that addresses 
the need to build general education teachers’ 
knowledge about and implementation of prac- 
tices to support the learning of SWD in the 
content areas. Studies of CAP-PD, however, 
add a needed focus on teacher practice. 

The work by Mastropieri, Scruggs, and 
colleagues highlighted the value of a struc- 
tured inquiry approach to science education 
for SWD, but their research was primarily 
focused on manipulating the curriculum as the 
independent variable (Mastropieri et al., 1999; 
Mastropieri et al., 1998; Mastropieri et al., 
2006). An example is their work with the key- 
word mnemonic strategy for learning the defi- 
nition of individual vocabulary terms. 
Although the keyword mnemonic strategy can 
and should be included as part of teachers’ 
instructional routines, it is not intended to be a 
transformative instructional practice that infil- 
trates all areas of instruction in science. There- 
fore, although teachers in Mastropieri and 
colleagues’ studies were responsible for 
implementing curriculum, the focus of their 
body of work was not on changing teacher 
practice. The researchers’ focus on curriculum 
alone overlooked the influence of teachers’ 
knowledge and skill related to evidence-based 
practice. It cannot be inferred from this work 
that—beyond the units of study included in 
these experiments—there was a change in 
teachers’ practice. Because CAP-PD studies 
use elements of teacher practice as the depen- 
dent variables, the impact of a PD interven- 
tion on teachers’ instruction is revealed. 


Reflection on Results 


PD offerings in science and beyond are typi- 
cally delivered using a “traditional” in-person 
model. This includes a trainer/expert of a new 
program or practice delivering content to 
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teachers during one or several sessions of 
varying lengths. Once the session ends, the 
teachers are largely left to their own devices to 
implement the new practice(s) or program, 
and receive little, if any, feedback. Research- 
ers across the past 20+ years have documented 
the inefficiency and ineffectiveness, overall, 
of this approach (Yoon et al., 2007). Multime- 
dia offers an intriguing alternative to the tradi- 
tional trainer/trainee model of PD; however, 
critical questions of implementation fidelity, 
dosage of PD content, and the appropriateness 
of match between content being learned and 
the multimedia delivery platform must all be 
explored and tested experimentally (Kennedy, 
Rodgers, et al., 2017). 

Results of the three pilot studies described 
in this article demonstrate that the amount of 
time and the number of evidence-based 
vocabulary practices that inclusive middle 
school science teachers incorporate into 
instruction can be increased without inten- 
sive face-to-face PD offerings. By using sim- 
ple multimedia (i.e., CAP-TV and CAP-TS) 
and sending a modest number of feedback 
emails using detailed descriptive data, teach- 
ers across the two studies made measurable 
gains in teaching performance. In addition, 
preliminary evidence now exists for the 
impact on learning of SWD. Other than the 
one-time cost of authoring and producing the 
CAP-TV and CAP-TS, no further invest- 
ments are required, and teachers can use 
these resources in perpetuity. Using the CT 
Scan to provide coaching does require an 
ongoing time commitment from a researcher, 
administrator, coach, or another professional 
to observe instruction either live or via video 
to generate feedback. Future flexible use of 
the CT Scan, however, as a part of regularly 
scheduled cycles of pre-service and in-ser- 
vice teacher observation and feedback could 
become a reality. 


Notes on iterative process. The iterative devel- 
opment of this project across the past several 
years holds important lessons for other 
researchers and teams seeking to undertake a 
similar project. A key lesson learned is the 
need to intensify PD offerings as much as 


possible. This includes ensuring curriculum 
materials are a good match for teachers’ needs, 
and providing intense and ongoing coaching 
to support implementation. A second lesson is 
not being satisfied with positive and statisti- 
cally significant results. The second and third 
studies introduced in this article resulted in 
desired outcomes by way of positive teacher 
gains. The researchers, however, did not 
declare victory and pronounce the PD inter- 
vention as being finalized. Instead, the team 
scoured teachers’ implementation, gathered 
informal feedback from participants, and 
made needed updates to further improve the 
process. Next, the decision to create an obser- 
vation tool to serve as a key dependent mea- 
sure for the project paid dividends and caused 
headaches. In other words, the iterative pro- 
cess of developing the CT Scan has been a 
project within the project. Researchers and 
teams should be very thoughtful and thorough 
when it comes to selecting the dependent 
measures for their projects, and in the instance 
when creation of something new is needed, be 
sure the team possesses the expertise and time 
needed for such an undertaking. 


Directions for Future Research 


Several lingering questions remain to be 
answered in future validation projects of the 
CAP-PD intervention process. First, further 
study of the individual components of CAP- 
PD is indicated. For example, the CAP-TV 
feature could be enhanced by embedding 
questions, including text overlays on the mod- 
eling videos, and other video animations. The 
degree to which these elements enhance learn- 
ers’ attention or distract from the desired 
learning experience deserves further study. 

In terms of teachers, questions remain about 
how to support teacher interpretation of the CT 
Scan feedback and the most efficient method(s) 
for maximizing the impact of the feedback 
given. Although we have collected social valid- 
ity data regarding perceived benefits of the CT 
Scan feedback, currently no data exist address- 
ing the degree to which teachers can read and 
interpret the CT Scan outputs. It is possible the 
outputs could be overwhelming and that limits 
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need to be placed on the amount and kind of 
information provided to teachers. Also, what 
are the best approaches for communicating to, 
and motivating, teachers based on the data out- 
puts? Currently, narrative feedback emails are 
written describing the visual output and direct- 
ing teachers’ attention to aspects of the visual 
graph, but there may be more effective and 
motivating ways to present this information. 
Incorporating goal setting by having teachers 
review their baseline data and set goals for the 
number of (a) practices they want to use in a 
lesson, (b) questions or feedback statements 
they want to provide in a lesson, and/or the (c) 
amount of time they want to spend in an 
instructional domain could be an appropriate 
strategy for motivating teachers to improve 
practice and one to explore in the future. 
Finally, once the development and refine- 
ment of CAP-PD in middle school science 
classrooms is completed, research could be 
extended into other grade levels and content 
areas. Many other secondary content areas 
have high vocabulary demands (e.g., history, 
mathematics). It is possible that teachers from 
disciplines other than science would respond 
differently to the CAP-PD package. 


Conclusion 


In general, results of the three pilot studies sug- 
gest that teachers understand and can use the 
CAP-PD, and that it is feasible to implement 
during typical science classroom instruction. 
The studies also reveal the CAP-PD to be a 
promising intervention to support inclusive 
middle school science teachers’ use of research- 
based vocabulary practices. The model—coach— 
scaffold cycle used across studies for helping 
teachers change their practice also provides an 
operationalization of the cognitive apprentice- 
ship conceptual framework. In continuing 
work in this domain, we aim to further explore 
how this conceptual framework is appropriate 
for iteratively designing a PD package for use 
with multimedia-based products. Researchers 
doing work in this domain can take lessons 
from our experience, in terms of gathering 
qualitative and quantitative data from small 
numbers of teachers and making incremental 


improvements to instructional materials. In 
addition, across these studies, researchers were 
continuously reminded of the need to make PD 
materials more intense, and specifically linked 
to teachers’ work. This resulted in our pairing 
of CAP-TV and CAP-TS curriculum materials, 
and the design and shaping of the CT Scan. 
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